Failure of the random phase approximation correlation energy 
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The random phase approximation (RPA) to the correlation energy is extended to fractional oc- 
cupations and its performance examined for exact conditions on fractional charges and fractional 
spins. RPA satisfies the constancy condition for fractional spins that leads to correct bond dis- 
sociation and no static correlation error for Hh but massively fails for fractional charges, with an 
enormous derealization error even for a one-electron system such as H^". Other methods such as 
range-separated RPA can reduce this derealization error but only at the cost of increasing the 
static correlation error. None of the RPA methods seem to have the discontinuous nature required 
to satisfy both exact conditions and the full unified condition, emphasizing the need to go further 
than just smooth functionals of the orbitals. 



The Random Phase Approximation (RPA) pQ, for- 
mulated within the adiabatic-connection fluctuation dis- 
sipation theorem, provides an appealing definition of 
the exchange-correlation energy. It can also be simply 
viewed [2| from a density-functional theory (DFT) per- 
spective as a functional of all (occupied plus virtual) or- 
bitals and eigenvalues in the Kohn-Sham (KS) formal- 
ism. There has been much recent attention to the RPA 
|3Sl5llia|, highlighted by the work of Furche [3], 
who has shown a practical way to calculate the correla- 
tion energy in the KS context in a similar fashion as in 
wave function approach 13! . Much of the interest in RPA 
comes from the improved description of two key aspects 
for which many other density-functional approximations 
(DFAs) encounter several problems: One is the descrip- 
tion of weak and Van-der-Waals interactions, as typified 
by molecules such as He2 or Ne2 ; the other is the descrip- 
tion of static correlation as seen in the stretching of H2 
[8] and N2 [10]. Other efforts to include unoccupied or- 
bitals into the exchange-correlation energy, such as MP2 
or GL2, have not been so successful with unphysical di- 
vergence for very simple systems [11] . Also the idea of 
range separation has been applied to the RPA correlation 
[5] , and interesting functionals including long-range RPA 
have been developed [4]. 

We have recently been attempting to gain insight [T2] 
into the problems of DFAs and other electron correlation 
methods relating to the derealization error [13] (frac- 
tional charge perspective) and the static correlation er- 
ror [14] (fractional spin perspective). The combination 
of these two in a unified condition [TS] is much more 
powerful and highlights a basic property of the exchange- 
correlation functional, that is its discontinuous derivative 
at integer number of particles in particular for fractional 
spin systems. This property is violated by all function- 
als in the literature and it is key, for example, for the 
accurate calculation the the band-gap of strongly corre- 
lated systems. The performance of a method can be in- 
vestigated by testing this unified condition for fractional 
charges and spins, which just requires a generalization 
of the method to include occupation numbers and frac- 



tional occupations as we have done recently for MP2 [TB] . 
This test is remarkably simple and illuminating, as it is 
sufficient to perform calculations on one-electron systems 
(e.g. the Hydrogen atom even with one basis function is 
enough). Our aim in this work is to carry out this simple 
test for RPA and investigate some of the implications for 
the method. This understanding offers insight about the 
largest errors of DFAs, but does not address the weak 
but very important Van-der-Waals energies. 

Consider the matrix representation of the RPA prob- 
lem ED 
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where the matrices A,B,X,Y arc of dimension 
n occ n virt x n occ n v . lrtl with n occ and n virt being the num- 
ber of occupied and virtual orbitals, and u> is the n occ n V i rt 
vector of excitation energies. RPA is given by the solu- 
tion of the above equations in the KS orbital basis with 

A ia , 3 b = {e a - ti)o~ia,jb + (ij\ab) (2) 
Bia.jb = (ij\ab) (3) 

where e are KS eigenvalues, i,j are occupied or- 
bitals, a, 6 are virtual orbitals, and (ij\ab) = 
J J mgMsigffiip )<M X ) d xc [ x ' where x is a combined 
space and spin coordinate. This corresponds to 
a Hartree-only density response with no exchange- 
correlation contribution. RPAE (also called RPA+X or 
full RPA) includes a Hartree-Fock response that requires 
antisymmetrized (ij\\ab) — (ij\ab) — (ij\ba) integrals in 
Eqs. [2j3] 

To extend the method to fractional occupation of 
the orbitals, the occupation numbers {n p } can be in- 
cluded into the basic matrices using an extension of the 
fluctuation-dissipation theorem to ensemble density ma- 
trices [P7] 

Aiajb — \£a ^i)^ia,jb 
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+ {ij\ab) x Jn l n J {\ - n a )(l - n b ) (4) 
= {ij\ab) yj riinj(l - n a ){\ - n b ). (5) 
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Figure 1: The closed-shell dissociation of H2 compared with Figure 2: The energy of H[n„,ttf] for < n a < 1 and < 
the fractional spin H atom n a — | + 7, = 5—7- All n/3 < 1. 
calculations, except Fig. [7] use a cc-pVQZ basis set. 



Partially occupied orbitals are considered both occupied 
and virtual, such that now i, j run over n occ + nf rac , a, b 
run over n f rac + n^n and the dimensionality of the ma- 
trices extends to (n occ + n frac )(n virt + n frac ) x (n occ + 
nfrac)( n virt + n frac) for n f rac number or fractionally oc- 
cupied orbitals. This is consistent with the perspective of 
fractional charges and spins resulting from dissociation. 
At the dissociation limit the HOMO and LUMO both 
become fractional. This appears to be a correct recipe to 
extend functionals of orbitals to fractional occupations. 
It gives a correct extension for all the orbital function- 
als with occupied orbitals (GGA, HF) and also for MP2. 
The RPA correlation energy is given by [3] 

^c RPA = \ - A iaM ) (6) 

ia 

with no additional (frequency or coupling constant) inte- 
grations and fully expressed in term of KS quantities. It 
should be noted that it is also possible to calculate the 
derivatives ^ by taking derivatives with respect to the 

frontier orbital occupation number, ^ = g^- , to get 
the band-gap as previously done for MP2 [IB]. 

We have implemented the above equations in a modi- 
fied version of CADPAC. We do this very simply by cal- 
culating the whole A and B matrices and then diagonal- 
izing according to Eq. [I] to give the excitation energies. 
This is computed post-PBE calculation using the frac- 
tional PBE KS orbitals and eigenvalues, to give the total 
RPA exchange-correlation energy E xc = E® xx + Ef PA . 
This functional could be also treated in a variational fash- 
ion using the optimized effective potential method (or its 
generalized version to accommodate nonlocal potentials 
in the case of for RPAE) , but this has not been done in 
this work. 

One of the promising aspects of RPA is that it greatly 



improves upon DFAs for the closed shell dissociation of 
H2. This is illustrated in Fig. [T] where the RPA energy 
is compared with LDA, Hartree-Fock (HF) and B3LYP 
[18] . RPA predicts the correct dissociation limit, which 
clearly correlates with the much improved behavior of 
the Hydrogen atom with fractional spins, H[^,|]. Re- 
markably, RPA satisfies the constancy condition, and all 
fractional spin configurations are degenerate in energy 
and equal to that of the pure spin H atom with [1,0]. 
It is possible to study in more detail the energy of the 
Hydrogen atom with general spin occupations, E[n a , up], 
as is shown in Fig. [2] The exact energy should be two 
flat planes that intersect with a line of discontinuity at 
n a + np — 1. We have shown previously |15j that smooth 
functionals of the occupied orbitals, such as LDA, GGA, 
HF and other hybrid functionals, are unable to qualita- 
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Figure 3: The dissociation of compared with the fractional 
charge H atom, n a = 8,np = 0. 
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Figure 4: The dissociation of He J compared with the frac- 
tional charge He atom, n a ,i = 1, n a ,2 = 1; np,i = 1, n fi,2 = S. 

tively give this discontinuous behavior of the E[n a ,np\ 
surface. Other methods involving virtual orbitals such 
as MP2 or its degenerate corrected version also fail [15] . 
For RPA, it might not be immediately clear from a con- 
sideration of the underlying equations whether the RPA 
energy has a discontinuity that is sufficient to give the 
desirable flat plane behavior. A simple test on the Hy- 
drogen atom shows that RPA also qualitatively fails and 
misses the discontinuity. Therefore, it is expected to fail 
for problems where this discontinuity is key, such as the 
band-gap of strongly-correlated systems. 

Very importantly, Fig. [2] reveals another real problem 
of RPA for the treatment of fractional charges, with an 
extremely convex behavior, much more so than LDA or 
other DFAs. To emphasize this erroneous behavior, Fig. 




Figure 5: The closed shell dissociation of N2 compared with 
the fractional spin N atom, n a ,i = l,n a ,2 = l,n a ,3 = n a ^ = 

n a ,5 = (5 +7); n P,l = 1,^/3,2 = 1,«0,3 = n/3,4 = Tip, 5 = 

(1-7). 
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Figure 6: A fractional spin Carbon atom calculated with 
n a ,i — 1, n a ,2 = 1, n a ,3 = n a A = (l — | j , n a , 5 = 3; np,\ = 
1 5 n /3,2 = 1- The spherical Carbon atom corresponds to S — |. 



|3] shows the dissociation curve of stretched Hj . The re- 
sult is astonishing, a simple one-electron system where 
RPA behaves extremely badly and give massive correla- 
tion energies. Another simple and paradigmatic case, the 
dissociation of HeJ is considered in Fig. [4] Again RPA 
fails dramatically, as shown for the He with fractional 
charges, leading to unphysically low correlation energies 
that affect not only the dissociation but also the bonding 
region. Again this error may not be obvious from the 
underlying equation, but is revealed by extremely sim- 
ple tests which highlight many important problems of 
the method. It is now clear that RPA suffers from large 
derealization error, which might be due to the lack of 
an underlying wavefunction and the poor quality of the 
Hartree-only response in RPA. This error is pervasive and 
can be seen in calculations of many different systems and 
properties. Thus the positive aspect of RPA in the im- 
proved description of Van-der-Waals systems such as Hc 2 
gets clouded by the spectacular failure to describe related 
systems such as He^". 

On a more positive note, we examine the behavior of 
RPA for some other challenging static correlation error 
problems. In general, the same improvement seen for 
H2 carries over to more complex systems, such as N2 in 
Fig. [5] where RPA is still very close to satisfying the 
constancy condition for multiple fractional spins. Fig. [6] 
considers the slightly different static correlation problem 
of the spatial degeneracy within the p set, as exemplified 
by the massive error of HF for an spherical atom against 
a non-spherical atom. In this case RPA makes a large 
correction to HF, and rather interestingly, it even makes 
the spherical atom sightly lower in energy, in contrast to 
most methods. These two posit ve aspects show that RPA 
deals well with this type of spin and spatial degeneracy 
and makes it a very interesting prospect to tackle more 
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Figure 7: The same as Fig. |2| except for a range-separated 
RPA functional, Eq. Q, calculated with a 6-31G basis set. 



tional, it still does not have the discontinuous behavior 
needed to satisfy both the exact conditions for fractional 
charge and fractional spin. RPA has a much reduced 
static correlation error but has a massive derealization 
error. In fact, the lack of discontinuous nature means 
that an improved performance for fractional spins likely 
leads to a much worse performance for fractional charges, 
and vice versa. For example with range separation the 
fractional charge behavior improves but the dissociation 
limit of H 2 worsens. The main purpose of this work is to 
highlight the importance of the exact conditions on the 
energy to be satisfied by methods in and outside DFT, 
and the complexity that is needed may not be covered 
easily by functionals of the unoccupied orbitals and eigen- 
values. 

Support from National Science Foundation and the 
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challenging problems of transtition metal chemistry. 

This analysis should be applied to any method to 
gain a deeper insight into its behavior. For example 
RPAE may not suffer from a massive derealization error 
but correspondingly it would no longer satisfy the con- 
stancy condition, performing worse for fractional spins 
and hence H2 dissociation. It is extremely difficult to 
improve both aspects at the same time and in a man- 
ner that leads to the flat plane behavior. There has also 
been much recent interest in including range-separation 
into the RPA ingredients. Following the work of Janesko 
et al. [4] we examine in Fig. [7] 
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where a value of (J, = 1.2 a.u. is used for the range separa- 
tion parameter and the £^ R . LDA [ s from Iikura et al. [19] , 
The ijLR,RPA j g ftpA with the long-range integrals in Eqs. 
2|3| This energy is evaluated using PBE orbitals and 
eigenvalues. Fig. [7] clearly illustrates that the effect of 
range separation is in general to move the surface up such 
that the error for fractional charges is decreased, however 
the good performance for fractional spin deteriorates cor- 
respondingly and the constancy condition is no longer 
fullfillcd. There are many other possibilities in meth- 
ods related to RPA and the fluctuation-dissipation the- 
orem, such as changing the eigenvalues (KS versus gen- 
eralized KS) and the kernel (going from RPA to RPAE). 
We would recommend that while developing such meth- 
ods at least stretched and H2 are considered, and 
if the extension to fractional occupations is possible the 
flat-plane behavior of Fig. [2] is investigated. 

We have investigated the behavior of some RPA based 
methods for the extension to fractional charges and frac- 
tional spins, to give insight into their performance for 
harder challenges in theoretical chemistry. Although 
RPA correlation is a complicated orbital dependent func- 
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